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The Pseudo Primal-Dual Algorithm solves the pure integer programming problem in two stages, 
systematically violating and restoring dual feasibility while maintaining an all-integer matrix. The 
algorithm is related to Gomory All-Integer Algorithm and the Young Primal Integer Programming 
Algorithm, differing from the former in the dual feasible stage by the choice of cuts and pivot variable, 
and from the latter in the dual infeasible stage by the use of a more rigid (and faster) rule for restoring 
dual feasibility. 

The net advance in the objective function value produced by the algorithm between two consecu- 
tive stages of dual infeasibility is shown to be at least as great as that produced by pivoting with the 
dual simplex method. Example problems are given that illustrate basic features and variations of the 
method. 
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1. Introduction 

The algorithm of this paper alternates between a 
dual feasible stage related to the Gomory All-Integer 
Integer Programming Algorithm [4] 1 and a dual in- 
feasible stage related to the Young Primal Integer 
Programming [5]. The Pseudo Primal-Dual algorithm 
departs from the Gomory and Young algorithms, how- 
ever, in its choice of cuts and pivot rules, and produces 
an objective function change between two consecutive 
stages of dual feasibility at least as great as produced 
by a pivot with the dual simplex method. In addition, 
the number of iterations of the dual infeasible stage is 
less than a particular coefficient in the preceding dual 
feasible matrix. 

Key features and variations of the algorithm are 
illustrated by detailed solution of example problems in 
the concluding section. 

2. Description of the Problem 

Using matrix notation, the problem we are concerned 
with may be written 

Maximize xq 
Subject to X = AT, 



X = 



x 

Xi 



T = 



-tn 



;0 for 7=1, 



. . . , m, 
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A = (A ,A, . . . ,A n )=(aij) 

i = 0, 1, . . . , mj=0, 1, . . . , n, 

where the general row equation of X~AT is rep- 
resented 



Xi=ajo+ 2) a*j(~*jM = 0, 1, 



,m 



(1) 



j=i 



and the last n equations initially have the form 



Xm- 



n+j 



=-(-*<), j=U • 



The above problem represents the ordinary linear 
programming problem Pi when the xi may assume 
fractional values and the pure integer programming 
problem P2 when the xt are required to be integers. 
As is well known, X — Aq provides an optimal solution 
to Pi when A is both primal and dual feasible, i.e., 
when mo = for i=l, . . . , m and aoj = for 7=1, 
. . . , n. If in addition A is all-integer X = Aq provides 
an optimal solution to P2. 



3. The Dual Simplex Algorithm and 
Gomory All-Integer Algorithm 



the 



The Dual Simplex Algorithm for solving Pi and the 
Gomory All-Integer Algorithm for solving P2 are 
closely related. A basic idea of these methods is to 
employ a nonsingular transformation of A and T to 
obtain a new representation X = AT for X. Thereupon, 

A and T assume the role of A and T, and the process 
repeats until an A matrix is obtained that satisfies 
the appropriate optimality criteria. 
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In applying the Dual Simplex Algorithm, A begins 
and remains dual feasible. The precise rules of this 
method are as follows. 

The Dual Simplex Algorithm (DSA )for Solving PI 

1. If dio^O for i = l, ... ,m, then X = A is 
optimal. Otherwise select r^l such that a r0 <0. 

2. If a r j = for 7=1, . . ., ft, then PI has no 
feasible solution. Otherwise, select u ^ 1 such that 
a ru < and 2 Aula™ > l Aj/a r j for all 7=1, 7^ ft, 
such that a r j < 0. 

3. Determine A by the rules: 



^*W Au/df 



Ay 



Aj — A u {a r jla r u) if; ^ ft. 



4. Let £ M = % r and £j = tj for 7 7^ a. Designate A and 

r to be the current A matrix and T vector and return 
to 1. 

The All-Integer Integer Programming Algorithm 
of Ralph Gomory modifies the DSA by introducing new 
equations called cuts to give the transformation of 

A into A. Specifically, in the context of P2, eq (1) 
implies the cut 3 



5i=[a i0 /X]+ J [aijl\\{-tj) 



(2) 



where 5? is a nonegative integer variable. 

For an appropriate value of k > 0, one may use (2) 
to determine A by replacing each occurrence of Orj and 
am in instruction 2 and 3 of the DSA by [a r j/k] and 
[a ru lk]. The initial A matrix is assumed not only to 
be lexicographically dual feasible, but also to consist 
entirely of integer coefficients. To keep A all-integer 
it evidently suffices to select k so that [a ru lk] = — 1 
(although the index u may not be the same for the 
DSA and the all-integer algorithm). Thus, the Gomory 
algorithm can be described as follows. 

The Gomory All-Integer Algorithm 

1. If aj = for i=l, ... ,/n, then X = A is 
optimal. Otherwise, select r^l so that an)<0. 

2. If a rj = for j=l, . . . , n, then P2 has no 
feasible solution. Otherwise, define a^ = [a r j/X], 
7 = 0, ... , n. Select v = 1 and k > so that a '=— 1 
and —A v > l Aj/a' for all 7 = 1, 7 5^ 17, such that a '. 
= -1. rj 



2 A vector a is defined to be lexicographically larger than a vector /3 (symbolized a> /3 
or /3 <-«) if the first nonzero component of «-j8 is positive. The condition of instruction 2 
implies the more familiar condition a ul<iru = Max {a jla r j :a r j< 0}, and also provides a 

i*i 
rule that assures a finite algorithm in the case of degeneracy. It is assumed here that A 
begins lexicographically dual feasible; that is, Aj >0 for all y ^ 1. Note that Apja^ = A q \arq 
for p t* q and p, q £1 is impossible since the initial Aj vectors for j^l contain the — / 
matrix, hence these Aj begin and remain linearly independent. 

3 [y] denotes the greatest integer ^ y. 



3. Determine A so that 

A v = A v ;A j = A J + aJ j A v j=0, 1, . . . ,/*,/ # v. 

4. Let t v = s r and 4 tj = tj for j^v. Designate 

^ and T to be the current A and 7 1 and return to 1. 

It is evident that the Gomory algorithm results 
simply by applying instructions 2, 3, and 4 of the DSA 
to the cut eq (2) instead of the source eq (1) (for 
i = r). Simplifications in the computation of k and v 
are given by Gomory in [4], where it is shown that 
finite convergence is guaranteed by periodically 
selecting r in instruction 1 to be the least i ^ 1 such 
that a io < 0. 

The fundamental ideas underlying the all-integer 
algorithm and the DSA provide the conceptual start- 
ing points for the Pseudo Primal-Dual Algorithm, 
whose strategy and special characteristics we develop 
to follow. 



4. The Pseudo Primal-Dual Algorithm 

The Pseudo Primal Dual Algorithm involves a 
sequence of "major iterations," each of which consists 
of several pivot steps using cuts of the form (2) de- 
rived from a single source row (or value of i). Each 
major iteration is divided into 2 stages. The first stage 
consists of a single pivot step. However, instead of 
selecting the pivot column v by applying the DSA 
criterion to (2) (as in the all-integer algorithm), the 
method selects v to be the same as u, i.e., by applying 
the DSA criterion to (1). In addition, X no longer 
truly serves as a parameter, but is always — a rM . 5 
If Stage 1 does not destroy dual feasibility, then Stage 2 
is vacuous. Otherwise dual feasibility is restored by a 
sequence of "pseudo-primal" pivot steps using the 
column that is lexicographically most negative when 
divided by the corresponding coefficient in the source 
row (restricting attention to positive coefficients). 

To specify the algorithm more precisely, we intro- 
duce the following additional notation. Relative to a 
selected equation r, let 

Aj =Ajla r j, j— 1, . . ., n, provided a r j ^ 0. 



(Likewise, for the matrix A we define Af=Ajla r j.) 
Let u be determined so that 6 



u ^ 1, a ru < and A J > Af for all j : ^ 1, 7V u 



such that a r j < 0. 



(3) 



4 The cut variable s r should in strictness be additionally subscripted (e.g., with the 
iteration number) to avoid ambiguity; s 3 from iteration 5 may not be the same variable as 
s 3 from iteration 9. 

5 Motivation for these choices is provided in [2], where it is shown that once u is selected, 
selecting \ ^ —a™ may be interpreted as applying the Bound Escalation Method [11 to 
an equation that is less constraining than (1). One of the consequences of this is mani- 
fested in Theorem 5, below. 

6 Note that this definition corresponds to the one given for u in instruction 2 of the DSA. 
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In addition, let s be determined so that 

* / 
a rs > 0, 5 ^ 1, and A s < Aj tor all j ^ 1, yV s, 

such that chj > 0. (4) 

Beginning with A all integer and lexicographically 
dual feasible, the Pseudo Primal-Dual Algorithm is 
then as follows. 

The Pseudo Primal-Dual Algorithm (PPDA) 

Stage 1 

1. If a^o = for t = l, . . ., m, then X = A is 
optimal. Otherwise, select r ^ 1 such that a r o < 
(periodically, r= Min {t : a^o < 0}). 

2. If a r j = for all yS 1, then P2 has no feasible 
solution. Otherwise, identify u by (3). 

3. Determine A so that 

A j = A j -\-[a rj l{ — a r u)]A u 7 = 0, . . ., n )^u. 

4. Let £ M = s r and fy = tj for 7 # ^. Designate A and 7 

to be the current A matrix and T vector. If Aj > 
for all j^ 1, return to instruction 1. Otherwise, 
Stage 2 

5. Retain the index r unchanged, identify s by (4), 
and let 

A s = A s 

Aj = Aj — [arj/ars] A s j = 0, . . . , n j¥^s. 

6. Let t s = s r and tj = tj for j 7^ s. Designate A and T 

to be the current A and T. If Aj > for all £S 1, return 
to instruction 1. Otherwise, return to instruction 5. 
We observe that instruction 3 of the PPDA employs 



(ar . = 0)=)^>0. 



(6) 



the Gomory cut (2) for i — r and X = 



yhile 



instruction 5 employs (2) for i — r and \ = a rs . Also 

the definition of s assures A s < 0, if there exists a 

7 = 1 such that Aj < and a r j > 0. 

Theorems and Proofs 7 

To justify the algorithm and develop its properties, 
we will undertake to establish the validity of two very 
simple and important relationships for every A matrix 
it generates: 



At<A?» 



(5) 



We observe to start that (5) and (6) must hold when- 
ever instruction 3 is initiated since the fact that A 
is always lexicographically dual feasible in Stage 1 
implies Aj > l for all 7 ^ 1, hence A* l < and A? >'0. 

To show that (5) and (6) hold throughout the al- 
gorithm we introduce _ 
Lemma 1. Let A w = K W A W and Aj = Aj — KjA w (j ^ w), 
for any scalars Kj, K w such that K w ^ 0. Then, if 
a rw #0 



if and only if 



a rjA w < Aj 



a rjA* < Aj. 



(7) 



(8) 



7 These wishing to defer consideration of the theorems and proofs can skip to the pre- 
liminary illustrative material of the next section with few sacrifices in understanding. 

8 By convention, we assume that A* <A* holds trivially if either u or s is not well-defined. 



From the definitions, 

Proof: a r jAl=arjA* = (arj-Kja rw )A* = a r jA^-KjA w . 
Also Aj = Aj — KjA w . Thus a r jA*—Aj=a r jA*—Aj, and 
the lemma follows at once. 9 _ 

The definitions of A w and Aj in Lemma 1 may be 
seen to accord with the definitions of A w and yfj at 
instruction 3 and 5 of the algorithm for w=u and 
w = s respectively. Furthermore, if a r j < 0, then con- 
dition (7) of Lemma 1 is the same as A* > A*, permit- 
ting w to be identified with u, while if a r j > 0, then 
(7) is the same as A* l <Af, permitting w to be identi- 
fied with s. With these observations as a foundation, 
we state and prove the key_ result alluded to above. 
Theorem 1: Let A w and Aj be given as in Lemma 1 
for w = r or v?= s, and let u and s be defined relative 
to the matrix A in the same way that u and s are de- 
fined relative to A. Then, if 

(5) A* '< A*, and (6) (a rj = 0) => Aj >' for all j ^ 1 

it follows that 

(5) A* l < A*, and (6) (a rj = 0) =) Aj ^ for all j ^ 1. 

PROOF: Letting either w= u or w = s, A* < Af is equiv- 
alent to 

A%< A*<^* for allp, q^ 1, p, qi^w, 

such that a rp < and a rq > 0. 

This immediately implies (7) of Lemma 1 for a r j ^ 0, 
and (6) implies (7) for a r j = 0. Thus (8) of Lemma 1 is 
true, which establishes (6) and 

Af<Al l <A* for allp, ^^1 

p, q ?^ w, such that a rp < and a rq > 0. 

But the existence of a w satisfying this last relation- 

9 This proof evidently permits the lexicographic inequality signs in (6) and (7) to be re- 
versed or replaced by equality signs. Also, the requirement a rw f* can be dropped after 
multiplying (6) through by a rw and (7) through by Or W , thus replacing A* and ~A% with A w 
and A w . 
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ship also implies that it must hold for w= u and w = s, 
and hence is equivalent to (5). 

We now restrict A w and ~Aj given in Lemma 1 to 
bring them into closer correspondence with the 
definitions provided by the algorithm. In doing so we 
establish the additional results required to demon- 
strate the properties claimed for the method in sec- 
tion 1. 

COROLLARY 1: Let A w and A ] be given as in Lemma 1. 
If K w < for w= s, and K w > for w = u, then (5) 
and (6) imply 

Al l <A*. 

w s 

PROOF: Since a rs > and a ru < 0, the sign restrictions 

on K w for w=u and w = s imply a rw < 0, and hence 

_ i 

either A%<A~ or w=u. The relations A% = A% and 

A^-< Af- immediately establish the corollary. 

COROLLARY 2: Let A w and Aj be given as in Lemma 1. 

i 
If A*, < for w — u or w = s, then (5) and (6) imply 

A j <0=)a rj >0, A j <0=)i rj >0/ora//j^l, (9) 



and 



A*,A*,A*,andA* 

I] 7 « ' II " s 



(10) 



are lexicographically negative (if they exist). 



PROOF: By the proof of Theorem 1, (5) and (6) imply 
(7) of Lemma 1 for both w=u and w = s. Thus if 

A* < for either w=u or w = s, it follows that 

A w < 0=) a rw > 0, since A\ < 0=)A U > 0, and a rs > 

i 
holds by the definition of s. Also, Aj < 0=) a r) > for 

j # w by {]]_ of Theorem 1. Then, since (7) implies (8), 
and A% = A^, the same argument applied to (8) yields 
the second half of (9) above. Finally (10) follows from (9). 
Corollary 1 establishes the important fact that Af 
(letting w = s) is always lexicographically increasing in 
Stage 2 of the PPDA. Corollary 2 implies that s will 
always be meaningfully defined at instruction 5 of the 
algorithm. We require one additional result to establish 
finiteness for Stage 2. 

Theorem 2: 10 For A given by instruction 3 of the 
PPDA, 

— a ru > a r j ^ for all j ^ u 

and for A given by instruction 5 of the PPDA, 

a rs >"a rj = for all j # s. 



10 An equivalent result was first given in the context of a primal algorithm by R. D. Young 
[5J and in the context of a dual algorithm at about the same time by the author in flj. An 
interesting and easily proved consequence of this theorem, which we do not exploit here, 
is that the "converse" of Theorem 2 is valid when Ajs given by instruction 5 of the algo- 
rithm with w replacing s at that instruction; i.e., if A-, = A , — \a r ilar w\A w. A w = — A lt ., then 
(5) and (6)' imply (5), (6) and w — s. A corresponding result holds when A is given by instruc- 
tion 3 with w replacing u. 



PROOF: From instruction 5, a r j= a r j —[a r jlars]a rs . 
Since y = [y]>y— 1 for all numbers y, and 

a rs > 0, a r j — {a r j — a rs ) > a r j. ^ a r j — a r j. 

The proof for A given by instruction 3 is analogous. 
THEOREM 3. Let 5 be the value of a rs on the first visit 
in instruction 5 during any execution of Stage 2. Then 
instruction 5 will be visited at most 8 times before the 
current execution of Stage 2 is terminated with Aj > 
for all j = 1. 

PROOF: From instruction 5, ~a rs = — a rs - Hence by 
Theorem 2, a rs < «r«. This can occur at most 8 times, 
since if s is still meaningfully defined at the 8 + 1st step, 
then Uri— 0, which is impossible. But by Corollary 2 
to Theorem 2, s must be meaningfully defined unless 
Aj ^ for all 7 = 1. This completes the proof. 11 

It should be noted that, while the value of 8 given 
by the preceding theorem provides an upper bound 
on the number of iterations of Stage 2, a larger value 
of 8 will not necessarily entail a greater number of 
iterations than a smaller one. 

Before stating and proving the theorem that estab- 
lishes finiteness for the complete algorithm, we give 
two theorems that disclose additional properties of 
Stages 1 and 2. 

THEOREM 4: Let w — u if A is defined by instruction 3 
of the PPDA and w = s if A is defined by instruction 5. 
Then _ 

Aj < 0, j # w 



implies 
where 



A w < Aj and — a pw < a pj , 
V = Min (i: a" iw # 0). 



PROOF: By Corollary 2_to Theorem 1 a r] < 0, and hence 
by the definition of 5", A* < Af orj=T. From Corollary 
1 to Theorem 1 it follows that A*<Af, and 
aowldrw =_£ojla r j. If a 0M = 0, then a r j = is im- 



plied by Aj < 0, and from A~ w 
dipwlarw = a } ,jlarj and 



K W A W we conclude 



dij — diw — cii W = for i < p. If a P j = 0, 

the theorem is immediately true. Thus, suppose 
a P j < 0. For w = s, we have a rs > a r j (Theorem 2) and 
a ps = —~a P s < 0. Consequently — a ps < a P j. The Theorem 
is similarly proved for w= u. 

Theorem 4 implies that dual feasibility (though not 
necessarily lexicographic dual feasibility) must be 
restored in Stage 2 in at most — ao s iterations, since 
cios < «o& must occur at every visit to instruction 5 as 
long as aos < 0. This rate of progression toward dual 
feasibility in Stage 2 is significant in that it exceeds 
any that can be proved for the primal all-integer 
algorithms. 12 



11 More restrictively S can be the value of a rs divided by the greatest common divisor 
of the a r j for j ^ 1. Also, note that Theorem 2 implies — a ru > 8, where a nt is given at instruc- 
tion 3, thus providing a known upper bound on the number of iterations in Stage 2 before 
it is initiated. 

12 The form of this progression has also led to a choice rule that guarantees finite conver- 
gence for a simplified primal method [3]. 
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Our next Theorem shows that the advance (decrease) 
in the objective function value in Stage 1 is always 
greater than or equal to that produced by the Gomory 
all-integer algorithm. 

Theorem 5: Let aio be the value of a o obtained at 
instruction 3 of the Gomory algorithm and a§o be the 
value of a o obtained at instruction^ 3 of the PPDA 
{for the same choice of r). Then a&o =«oo- 

PROOF: aio = tfoo + ao v [a r o/\\ and 

a$ = a o + ao u [a r ol( — a ru ) I 

From the choice of A and v specified in instruction 2 
of the Gomory algorithm, we have 



[a rM /X] ^ aoulaov, 



hence 



— [a rM /X| ^ [sLoJaov], and a rM /X ^ — [aou/aov]- 

Since a r o < and 

a ru < 0, a r{) l\ ^ — (arol™) [ao u la 0v \ ^[aro/(— a r u)][a 0u /ao v ]. 

But aojaor /flow] = flow and [a r o/( — «r«)J < 0, and thus 
aoi>[aro/A] = «o M [«ro/(— Om)]. This implies oj = «oo, 
completing the proof. 

We now show that the net lexicographic decrease 
in Aq brought about by the PPDA is at least as great 
as that produced by the dual simplex algorithm. As 
remarked earlier, this immediately implies that the 
PPDA is finite, thereby completing the justification 
of the algorithm. 

THEOREM 6: Given the same A matrix and the same 
choice of r, the amount of the lexicographic decrease 
in A resulting from two successive visits to instruction 
1 of the PPDA equals or exceeds that resulting from 
two successive visits to instruction 1 of the DSA. 

PROOF: Let A denote the A matrix on the first of two 
consecutive visits to instruction 1 of the PPDA, and 
let X denote A on the second of these visits. In addi- 
tion, for each iteration h at instruction 5, let A h (h ^ 1) 
denote the current A matrix and let K h = [a%la%\ lz 
Then we may write 



Ao = Ah-^ 



K"M 



a,-n = a' n) — ^ K h a%. 



(11) 



(12) 



By the definition of u, the A {) vector that replaces 
A§ on the second of the two visits to instruction 1 of 
the DSA is A% — a%Al*. (We note that this results in a 
lexicographic decrease in A since a% < and Aff < 0.) 
Thus, to prove the Theorem we must show that 
A() < A —^a r oA u . 

Since a r o = 0, from (12) we obtain 



h ^ 2 

Also, from the definition of /4J*, 

2 KM* =2 K"a'kA'i*. 



(13) 



(14) 



By Corollary 1 to Theorem 1, it follows that 4J* > A*!* 
for all h a 1. Since K" s and a*, S ] , (14) implies 



I 

Also, since A l £* < 0, we have by (13) that 

(lroA u =A U 2^ Ors- 
h^2 

Thus, from (11) we conclude 



(15) 



Finally, using the fact that a r uAu* = A%, the definitions 
of A<& and a% yield 



A\) a r (y4 u — Aq a r( )A u . 



(16) 



But A X =A ( \ hence (15) and (16) establish the desired 
result. 



5. Example Problems and Comments 

Three problems are solved in this section to illustrate 
the fundamental characteristics of the PPDA. In 
addition, variations of the PPDA are developed by 
informal example. 

Example problem 1: ,4 

Maximize x = ■+■ 23( - x 3 ) + 17( - x 4 ) + 3( - z 5 ) 

+ 7(-s 6 ) 
subj. to x 1 =-128-27(-x.,)-20(-^4)-16(-X5) 

-17(-*«) 
x 2 = - 45 - 22( - xz) ~ H( -x x 4 ) + 9( - x 5 ) 

+ 2(-X6),Xj^0foYJ^ l. 



1:1 We do not bother to represent the fact that 5 depends on h. 



14 This problem may also be written in the form 

Minimize 23x 3 + Ylx* + 3x r> + 7x« 

s.t. 27x 3 + 20x4 + 16x s + 17x6 > 128 
22x 3 + 14x 4 - 9x 5 - 2x 6 > 45 

for nonnegative integer xj, where x x and x 2 are introduced as slack variables to change 
the inequalities into equalities. 
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Representing X = AT in detached coefficient (i.e. 
tableau) form, we have 



0. 



i 



— Xs ~x 4 —x 5 —x 6 



x = 





23 


17 


3 


7 


Xi = 


-128 


-27 


-20 


-16 


-17 


x 2 = 


-45 


-22 


-14 


9 


2 


Xs = 





-1 











X 4 = 








-1 








x 5 = 











-1 





x 6 = 














-1 



Beginning with instruction 1 of the PPDA, we 
observe that am < for i = 1 and 2, and hence proceed 
to instruction 2. Equation r is selected at this step to 
be the one with the fewest negative components. 15 
Thus, r=2, as indicated by the arrow in the tableau 
above pointing to row 2. From the definition of A u *, 
u=\ when r= 2, hence the arrow pointing to column 1 
(Ai). Instructions 3 and 4 then yield the new tableau 



1. 



-5 2 



4 

— X 4 



-*h 



-x 6 



x = 


-69 


23 


-6 


3 


7 


Xi = 


-47 


-27 


7 


-16 


-17 


x 2 = 


21 


-22 


8 


9 


2 


x 3 = 


3 


-1 


1 








X 4 = 








-1 








*5 = 











-1 





x 6 = 














1 



In this tableau A 2 < 0. Therefore, with r still at 2, 
we proceed to instruction 5 and apply the indicated 
transformation for 5 = 2. The updated tableau obtained 
at instruction 6 is then 



i 



2. 



-57 


5 


6 


9 


7 


-61 


-6 


-7 


-23 


-17 


5 


2 


-8 


1 


2 


1 


2 


-1 


-1 





2 


-3 


1 


1 














-1 

















-1 



Since the Xi along the left margin are unchanging 
and the tj along the top margin are irrelevant, we do 
not bother in this and subsequent tableaus to specify 



the identity of these variables. In Tableau 2, Aj > 
for all j = 1, requiring a return to instruction 1. Since 
aio = — 61 < 0, instruction 2 is visited next, and r=l 
is the only choice. Now w=3, and by instructions 3 
and 4 we obtain 



l 



3. 



-84 


-4 


-3 


9 


-2 


8 


17 


16 


-23 


6 


2 


1 


-9 


1 




4 


3 





-1 




-1 


-4 





1 


— 1 


3 


1 


1 


-1 
















— 1 



Once again A is dual infeasible. From its definition, 
5 = 4, thereby at instructions 5 and 6 yielding the 
tableau 



-82 





1 


1 


2 


2 


5 


4 


1 


-6 


1 


-1 


-11 


5 


— 1 


3 


1 


-2 


3 


— 1 





-2 


2 


-3 




2 


-1 


-1 


3 


— 1 


1 


2 


2 


-4 





A is now both primal and dual feasible, and the 
problem is solved. From X = A we obtain the optimal 
solution xo = — 82, #i = 2, x 2 = l, #3 — 3, x 4 = 0, x 5 — 2, 
x 6 = 1. 

The next example problem illustrates additional 
features of the algorithm. 

Example problem 2: 

Maximize x = + 3(— x 2 ) + 5(— Xs) 

+ 9(-s 4 ) + 7(-* 5 )+13(--*6) 

subj. to xi = - 398 - 6 (- x 2 ) - 15 (- x 3 ) - 36 (- x 4 ) 



-23 (-^ 5 ) -41 (-xe)xj^0j=l, 



6. 



For convenience we will not bother to write down 
the last five rows of the tableau corresponding to the 
— / matrix and zero vector, but will explicitly represent 
these rows only when they are changed from their 
original form. Thus, for the initial tableau we have 



i 



= 





3 


5 


9 


7 


13 


= 


-398 


-6 


-15 


-36 


-23 


-41 



15 Our choice here is based on considerations developed in [1]. 



0. 



The arrows accompanying the tableau point to row 
r and column u. Since w = 3, the third row of the origi- 
nal — / matrix (corresponding to x 4 ) will be modified 
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by the transformation defined at instruction 3. Thus, 
in the resulting tableau below this modified row is 
included following the modified rows and 1. We keep 
track of the components of X in the left margin since 
their order has been shuffled by our bookkeeping 
conventions. 

i 



= 


-108 


-6 


-4 


9 


-2 


-5 


= 


34 


30 


21 


-36 


13 


31 


= 


12 


1 


1 


-1 


1 


2 



At instruction 5 the transformations are initiated 
to restore A to dual feasibility. Since s=l, the first 
row of the original — / matrix (corresponding to x 2 ) 
will now be changed, yielding the new last row in the 
tableau below. 



2. 



1 



X 4 = 

x 2 = 



-102 


6 


-4 


-3 


-2 


1 


4 


-30 


21 


24 


13 


1 


11 


-1 


1 


1 


1 


1 


1 


1 





-2 





1 



This tableau is still dual infeasible and instruction 
5 must therefore be repeated. 



3. 



1 



Xo = 

x 4 = 
x 2 = 

X 3 = 



-102 


-2 


4 


1 


-2 


-1 


4 


12 


-21 


3 


13 


1 


11 


1 


-1 





1 


1 


1 


1 





-2 





1 





-2 


1 


1 









Once again repeating instruction 5 we obtain 



X = 


-102 


2 





1 





1 


Xi = 


4 


-12 


3 


3 


1 


1 


X4 = 


11 


-1 


1 








1 


x 2 = 


1 


-1 - 


2 


-2 


-1 


1 


X 3 = 





2 


-3 


1 


2 






The problem is now solved, and an optimal solution 
is given by xq = — 102, *i = 4, #4= 11, #2=1, and 
x 3 = x 5 = x 6 = 0. 

For the proceding problem, we note that the optimal 
solution was already given in Tableau 2. Since A was 
not dual feasible, however, the solution was not identi- 
fied as optimal at that point. Nevertheless, it would 
have been possible to make this identification in the 
following way. 

We create a new column from A s (s = 2) in Tableau 
2 by dividing A s through by — a 0s (=4) 16 and then adjoin 
this column to the right of the others in the tableau. 
Since the variable associated with this column (call 



it z) must be zero in the final solution, we also adjoin 
the two equations to assure z^0 and — z^0 at the 
end of the tableau. Thus we obtain 



2'. 



i 



-102 


6 


-4 


-3 


-2 


1 


-1 


4 


-30 


21 


24 


13 


1 


21 
T 


11 


-1 


1 


1 


1 


1 


1 

4 


1 




J 









-2 









1 







-1 
1 



Xo z 

X4- 

x 2 ~- 

z - 

— z = 



The new column is segregated by the added parti- 
tion. It is evident by its construction that this column 
must qualify as the new A s . 17 

It is unnecessary to carry out the computations at 
instruction 5 in order to predict two things about the 
matrix A that will result. 

First, since the first component of the new column 
in Tableau 2' is — 1 and the components of row are 
integers, 18 it follows from Theorem 4 that a j = for 
all 7 l£ 1 such that Aj < 0. Consequently, then, A must 
be dual feasible (though perhaps not lexicographically 
dual feasible). 

The second thing to observe is that [a r o/a r s] = 
21\ 
-T-l, and hence A = A {) . This 

one just established assure that the 
(primal) feasible solution values for the x\ given in 
Tableau 2 (and 2') must also be optimal. In short, we 
have established that [arola rs ] = is a sufficient con- 
dition for a feasible solution to be optimal. 

If adjoined rows and columns are actually employed 
in solving the problem, and not simply as a means of 
checking for optimality, then it will eventually be 
possible to restore the tableau to its original size. 19 
This approach of adjoining columns may also be used 
at Step 2 to prevent A from becoming dual infeasible 
in the first place. There are clearly a number of pos- 
sible variations, and by following appropriate rules 
the tableau need not be expanded to the extent de- 
picted by our illustration each time a new variable 
is added. To insure convergence it is of course neces- 
sary to forbid the addition of an unlimited number of 
rows and columns to the tableau. 

Our last example problem is a very simple one that 
poses considerable difficulty for Stage 2 of the PPDA. 



for a r o = 4 and a 
fact and the 



of A 



If ao, = 0, we instead divide through by the negative of the first nonzero component 



17 More generally, if course, we could adjoin any column A h < (to qualify as the new 
A s ) such that A* l <A*< A*. 

18 By permitting rational numbers in the tableau, it suffices more generally to select the 
first component of the adjoined row to be — l/k, where kay is an integer for all i and / If 
row already consists of negative components, then our remarks have reference instead 
to the first row i such that a is ¥= 0. To demonstrate that a feasible solution is optimal, how- 
ever, consideration may be limited as above to row 0. 

19 By selecting row r to be one or the other of the adjoined rows (which will always be 
negative of each other), and persisting in this, eventualls there will remain only one column 
of the tableau with nonzero components in these rows, at which time the indicated column 
and rows may be dropped. The optimal solution may of course be obtained before this 
size reduction process is completed. 
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(We will later show how to overcome the difficulty 
by making the algorithm more flexible than the ver- 
sion of section 3.) 

Example problem 3: 

Maximize *o = + l(-* 2 ) + 28(-* 3 ) 

subj. to xi = -98 - 1(- x 2 ) - 45(- x 3 ) 



Xj^O forj^l. 



I 






1 


28 


-98 


-1 


-45 





-1 











-1 



0. 



The next three tableaus are written without addi 
tional comment. 



i 



i. 



-84 


-27 


28 


37 


44 


-45 





-1 





3 


1 


-1 


1 


-84 


27 


-26 


37 


-44 


43 





1 


-2 


3 


-1 


1 


i 


-84 


-25 


26 


37 


42 


-43 





-3 


2 


3 


1 


-1 



One may infer from the structure of this problem 
that after six more steps we will obtain 



-64 


-19 


20 





36 


-37 


8 


-9 


8 


2 


1 


-1 



This tableau gives an optimal solution by the re- 
marks relating to the previous example problem. How- 
ever, to restore dual feasibility we may project by 
inference that 20 additional iterations of Stage 2 are 
required, at which point we obtain 



-64 


1 








-18 


17 


8 


27 


-28 


2 


-1 


1 



Two interacting features of Tableau 1 bequeathed 
by Stage 1 appear to have contributed to the difficulty 
encountered in Stage 2: (i) Af and A* are nearly the 
same, and (ii) the components a 3 and a r3 of the vector 
As = Ai~\- A 2 are small in absolute value relative to the 
corresponding components of both A\ and A 2 . 20 

Conditions such as these may be taken to indicate 
that the transformation employed in Stage 1 should 
be modified to provide a different A matrix for Stage 2. 
Specifically, we interpret (i) and (ii) to imply that the 
choice of u in Tableau would better be given by 
u = 1 instead of u = 2. 

How is such an altered choice possible? Note that, 
if the coefficient of an in Tableau were decreased 
sufficiently, then u=l would result by definition. 
Thus we wish to adjoin to the tableau a new equation 
(to be designated equation r) which is the same as 
eq (1) except that the coefficient of — 1\ is appropri- 
ately decreased. Such an equation can always be 
created by adding a sufficient positive multiple M of 
ti=— 1(— Ji) to eq (1). Denning x± = X\ + Mt^O) in 
Tableau 0, we have 

Z4 = -98-(l + M)(-*i)-45(-* 2 ). 

To assure u=l when equation 4 assumes the role of 
equation r, we require — 1/(1 -f-M) > — 28/45 or 
1+ M > 45/28. Consequently we assign — au the value 
45/28 + e (- au = 1 + M) , for e > 0. 

Adjoining the new equation to Tableau yields the 
augmented tableau. 21 



0'. 







i 


Xo = 
Xi = 

Xo — 

Xs = 



-98 




1 28 
-1 -45 
-1 

-1 


X A = 


-98 


-$+■)-« 



Note that by letting au be a ru in this example, the 
process of selecting a value of au corresponds pre- 
cisely to selecting a value of X for a Gomory cut, when- 
ever the transformation of A into A is carried out as 

45 
specified in the PPDA. 22 In particular, — au = — gives 

the (largest permissible) X value prescribed by the 
All Integer Algorithm (using eq (1) as source equation). 
Suppose instead, however, that we wish to select 
au by taking € arbitrarily small. The effect of this in 
transforming A into A with the PPDA can easily be 
given without specifying a value of € at all, provided 
the updated form of equation 4 itself is disregarded. 



20 One can readily make these conditions more precise by the type of "difference" analysis 
that permits the last two tableaus above to be inferred without carrying out the intervening 
computations. (There is of course no difficulty in defining (i) and (ii) for more general situ- 
ations. For simplicity, however, we continue our discussion by reference to the example 
problem.) 

21 The transformations of the PPDA and the theorems of the preceding section do not 
require x r to be an integer variable or equation r to contain integer coefficients. 

22 The Gomory all-integer algorithm can be described in terms of the algorithm of [1] in 
this way. See e.g., [2]. 
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To see this we observe that for any number y and 
— a rM = y-fe (with € arbitrarily small), we have 

[a r jl(— am) ] = [a r jly] - 1 

if a,j < and a r j/y is noninteger, while 

[arjl(-a r u)] = [arjly] 

otherwise. Thus, by instruction 3 of the PPDA we 
obtain from Tableau 0' 



1'. 



where we have dropped equation 4 from the new 
tableau. 

However, dropping this equation is not permissible 
by a straightforward application of the PPDA since 
A is not lexicographically dual feasible, and equation r 
is required to define the transformation in Stage 2. 
To remedy this apparent difficulty, we note that The- 
orem 1 and its corollaries immediately imply that the 
equation t u = — 1(— t u ) will be transformed by instruc- 
tion 3 into an equation that satisfies the criteria for 
equation r. 

In our present example, eq (3) corresponds to t u = — 1 
(—t u ) 23 in Tableau 0' and hence qualifies as equation 
r in Tableau 1'. Applying instruction 5 of the PPDA 
to Tableau 1' for r=3, we obtain 









i 




-61 


1 







-37 


-1 


-17 


— > 


61 


-1 


28 










-1 



-61 


1 





-3 


-18 


17 


5 


27 


-28 


2 


-1 


1 



- 3 lf this equation does not appear in the tableau, it can always be added. 

"Tableau 2' illustrates the applicability of an additional solution strategy that can 
be employed in conjunction with the PPDA. The submatrix consisting of the two middle 
rows of the tableau is a special instance of a structure called the bounding form, which 
frequently appears in certain "hard" integer programs and can be exploited efficiently 
with the algorithm of [1]. 



2'. 



The PPDA now obtains an optimal solution after six 
more steps, considerably improving upon the solu- 
tion attempt that disregarded the form of the A matrix 
encountered in Stage 2 (as a result of the Stage 1 
transformations). 24 

Other related ways for increasing the range of 
alternatives available to the PPDA are suggested by 
the foregoing discussion. For example, one may 
create a new equation to take the role of equation r 
by decreasing more than one of the a r j (or even increas- 
ing a r0 ), applying this in Stage 2 as well as Stage 1 
provided Aj l <0-* a r j>0 and At '< Af for the new 
equation r. Also, if there is a second equation that has 
the appropriate form for equation r in Stage 2 and has 
the same value for s, then it is easily proved that 
any convex combination of the two equations will 
qualify as the new equation r. 
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